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RF ID AND LOW RESOLUTION CCD SENSOR BASED POSITIONING SYSTEM 



BACKGROUND OF THE INVENTION 

( 1) Field of the Invention 

[0001] The present invention relates to a system and a method for low-cost and high- 
performance absolute position referencing for elevators and other conveyances. More 
specifically, the present invention relates to a system incorporating both RF ID sensing 
technology and CCD image processing to accurately assess the position of a moveable platform. 



(2) Description of Related Art 

[0002] A Positioning Reference System (PRS) is a component of an elevator control system that 
provides fast and accurate position measurement of a moveable platform, in particular an 
elevator car, in a hoistway. Traditional optical elevator position reference systems (PRS) exhibit 
a number of attributes that render them less than operationally optimal. 

[0003] One method of employing a PRS comprises using a coded tape defined by two tracks of 
openings cut along the length of the tape. The coded tape spans the entire longitudinal length of a 
hoistway. An optical sensor, mounted on the elevator car, consisting of a light transmitter and a 
receiver reads the binary coded information from the coded tape, and relate the readings to the 
actual position of the elevator car in the hoistway. 

[0004] A disadvantage of this system is that longitudinal expansions of the hoistway as well as 
the coded tape can cause positioning errors. Another disadvantage of this system is the high 
installation costs involved in the installing the tape in the hoistway. 

[0005] An alternative method involves the use of reflectors mounted on the wall of a hoistway 
having two tracks of coded symbols printed on reflectors for elevator car positioning. The 
symbols are detected and evaluated by a two-channel evaluating subsystem, which has optical 
transmitters for illuminating the tracks and charge-coupled device (CCD) sensors for detecting 
the reflected images. Pattern recognition logic for each channel recognizes patterns in the images 
and generates elevator car position information. 

[0006] A disadvantage of this system is that it requires the use of two CCD cameras for 
generating elevator car position: one for reading the floor coarse position information and other 
one for fine positioning information. If redundant systems have to provide data for the normal 
terminal stopping device (NTSD) and the emergency terminal stopping device (ETSD), the 
resultant system configuration would cause the production cost to be quite high. Since the system 
is intended to provide linear position feedback along the hoistway, the coding of the white and 
dark patterns on the reflector has to be very fine. Very fine coding patterns make the system 
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susceptible to dirt and dust contaminations that may blur the coding patterns causing inaccurate 
car position information. Another disadvantage is the great effort required for installing the 
reflector along the path in the elevator hoistway. 

[0007] What is therefore needed is a high-accuracy positioning means with low cost for 
installation, and maintenance. 



[0008] Accordingly, it is an object of the present invention to provide a system and a method for 
low-cost and high-performance absolute position referencing for elevators and other 
conveyances. More specifically, the present invention relates to a system incorporating both RF 
ID sensing technology and CCD image processing to accurately assess the position of a 
moveable platform. 

[0009] In accordance with the present invention, a positioning system for a moveable platform 
comprises an RF reader for receiving coded data from at least one RF tag positioned at a known 
location, at least one optical device for capturing an image of a visual cue positioned at a known 
location, means for decoding the encoded data, means for processing the captured image to 
determine the position of the visual cue, and means for combining the decoded data and the 
detected visual cue to calculate a position of the moveable platform. 
[0010] In further accordance with the present invention, a method for determining position 
comprises the steps of providing a plurality of RF tags at fixed positions, providing a plurality of 
visual markers at fixed positions, affixing an RF reader to a moveable platform, affixing an 
optical device to the moveable platform, using the RF reader to receive coded information from 
one of the plurality of RF tags, imaging at least one of the plurality of visual markers with the 
optical device to produce an image, performing image processing on the image to identify a 
position of a visual cue in the image, combining the position of the visual cue with the coded 
information to determine a location of the moveable platform. 



SUMMARY OF THE INVENTION 



BRIEF DESCRIPTION OF THE DRAWINGS 



[0012] FIG. 2 



[0011] FIG. 1 



Schematic illustration of the RFID/CCD elevator positioning system of the 
present invention. 

A detailed depiction of the optical device and visual marker of the present 
invention. 



[0013] FIG. 3a 



A graph of the pixel values of an idealized one dimensional image of the 
present invention. 
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[0014] FIG. 3b A graph of the pixel values of a typical one dimensional image of the 
present invention. 

[0015] FIG. 4 A block diagram of the steps performed during the image processing of 

the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S) 
[0016] This invention centers on a positioning concept incorporating both RF technology and 
visual image processing to precisely locate the position of an elevator car. In a preferred 
embodiment, a number of RF tags encoded with location information are situated at known 
locations on and around the doorways lining an elevator hoistway. As the elevator comes into 
proximity with the RF tags, the encoded information is read by an RF reader attached to the 
elevator so as to determine the floor location of the elevator. Having determined the floor 
location of the elevator, a visual marker, preferably a horizontal line affixed to the hoistway 
doorframe at a precisely known position, is visually scanned. The scanned information is image 
processed to provide the precise position information of the elevator. 

[0017] The major components of the PRS 1 of the present invention are shown with reference to 
Fig. 1. A number of radio frequency (RF) tags 21, coded to represent floor information and car 
status information, are attached on the doorframes 13 of a hoistway. Attached in proximity to, 
preferably to the side of, the RF tags 21 are a number of visual markers, either white or colored, 
spaced apart on the doorframe 13. In operation, an RF reader 19 mounted on the elevator car 29 
reads the RF tags 21 in a direction of movement of the elevator car along the path of travel. The 
approximate position of a car 29 approaching a certain floor is detected by the RF reader 19. The 
approximate position and direction of motion gives status information such as car entering into a 
floor, car entering the landing zone, or car leaving the floor. Based on the car status data, fine 
position is provided by an optical device 17, preferably a CCD detector, installed on the elevator 
car 29. The car position is calculated using the displacement of the image of the visual mark 23 
on the imaging plane of the optical device 17. 

[0018] The RF tags 21 are passive transponders that do not require power supply. When the RF 
reader 19 passes over an RF tag 21, the RF tag 21 is charged remotely by the RF reader 19. As 
soon as the RF tag 21 is charged, the identity of the RF tag 21 is sent over to the RF reader 19. 
After the data of car status and floor number are passed over to the RF reader 19, a 
microprocessor 27 combines the data along with the visual reflector 23 position information 
acquired by the optical device as described more fully below. 

[0019] With reference to Fig. 2 there is illustrated in greater detail the interaction of the optical 
device 17 and the visual marker 23. Visual marker 23 is of any configuration incorporating a 

3 



03-293-US 

visual cue 3 1 the exact position of which may be determined and which can be captured as an 
image by optical device 17. In a preferred embodiment, visual cue 31 is a horizontal line whose 
position has been precisely determined. Visual marker 23 is preferably placed such that it falls 
within the field of view 1 1 of optical device 1 7 when one or more RF tags 23 indicative of a 
particular floor are within range to be read by RF reader 19. In practice, visual cue 3 1 may be 
any visual indicia possessing a feature or features which can be precisely imaged. In the 
embodiment shown, visual cue 3 1 comprises a horizontal line having two edges separated by a 
width w. The image of visual marker 23 containing visual cue 3 1 captured by optical device 
may be one or two dimensional. In the instance where the visual cue 3 1 is susceptible to a one 
dimensional scan, optical device 17 may be chosen to produce a one dimensional image formed 
by visually scanning visual marker 31 along scan axis 42. In another embodiment, optical device 
17 may be chosen to produce a two dimensional image formed by visually scanning visual 
marker 31 across a two dimensional plane. 

[0020] In the instance of a one dimensional image, the image formed of visual cue 31 is a one 
dimensional array comprised of picture elements, or pixels, having a value related to the 
intensity of reflected light recorded by optical device 1 7. With reference to Fig. 3a, there is 
illustrated a graph of the theoretical pixel values which would be recorded by an optical device 
17 after imaging a visual cue 3 1 such as that of Fig. 2 wherein the x-axis corresponds to scan 
axis 42. As one proceeds along scan axis 42, the intensity of each pixel, as measured on the y- 
axis is ideally zero until one reaches the edge of visual cue 3 1 . After reaching the first edge, the 
intensity of the pixels increases to a finite value and remains of generally steady intensity until 
dropping back abruptly to zero. In the present example, the width w of visual cue 3 1 is exactly 
three pixels. In addition, the first edge of visual cue 31 is located a distance p from the top of 
scan axis 42. In this idealized example, distance p is an integer multiple of the width of a single 
pixel. 

[0021] Once distance p has been precisely deduced from the image, it is possible to compute the 
precise location of the elevator car. The lateral distance between the optical device 17 and the 
doorframe 13 upon which the visual marker 23 is mounted is generally constant as the elevator 
car 29 moves along the hoistway. Therefore, it is possible to calibrate the optical device 17 so as 
to map each pixel location in an image captured by the optical device 17 to a physical location 
on a plane located a distance essentially identical to the distance between the optical device 17 
and the doorframe 13. 

[0022] At installation, the precise position of each visual marker 23 is recorded and stored in 
memory device 41. Memory device 41 may be of any media type capable of storing and 
retrieving digital data. 
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[0023] Fig. 3a describes a theoretically perfect instance of an image of visual cue 31 . In such an 
example, the edge of visual cue 3 1 falls precisely at an integer multiple of pixels from the edge 
of scan axis 42. In such an instance, it is possible to exactly determine the distance p and, hence, 
the location of visual cue 31. In practice, however, a graph of the pixel values comprising a one 
dimensional image resembles more closely that illustrated in Fig. 3b. Note that there is no 
clearly defined beginning of the edge of visual cue 3 1 . Rather, pixels on either side width w, are 
near to, but not precisely, zero, and the pixels between width w exhibit attenuated Gaussian 
characteristics. 

[0024] In such an instance, it is still possible to determine the position of the first edge, and 
hence, distance p. There exist numerous convolutions, as well as linear and non-linear imaging 
techniques known in the art for detecting edges in images. One advantage of such techniques, 
collectively known as sub-pixel resolution algorithms, is the ability to detect edges and other 
features with sub-pixel resolution. For example, if a single pixel in the image corresponds to 
0.01 inches on the visual marker 23, sub-pixel image processing can deduce the location of an 
edge to 0.001 inches. The ability to perform sub-pixel processing allows for the use of relatively 
crude imaging apparatus from which precise location information can be deduced. 
[0025] The steps for decoding the images coming from the optical device, preferably a CCD 
sensor, is accomplished through a signal-processing unit 51 explained in Fig. 4. Signal 
processing unit 51 preferably runs on microprocessor 27 and may take the form of dedicated 
hardware or may be implemented as software running on microprocessor 27. The captured 
visual marker 23 image is processed using a sub-pixel resolution algorithm that has been built 
into the microprocessor. The car position is determined using the pixel intensity distribution of 
the visual marker 23 within the field of view 1 1 of the optical device. The center, or other 
defined feature, of the visual marker 23 is calculated and compared with the center of the image 
acquired by the optical device. The difference between the two locations gives the relative 
position of the car at a floor level. As noted, the sub-pixel image processing algorithm allows the 
use of cheap low-resolution CCD sensors for car positioning. The sub-pixel algorithm may make 
use a mathematical model of the expected image characteristics of the visual marker 31, 
computed and stored in memory device 41, to enhance the physical resolution of a CCD sensor, 
e.g. from 1 x256 pixels to 1 x2048 pixels with required accuracy of a PRS. Alternatively, the sub- 
pixel processing may utilize convolutions, as well as linear and non-linear imaging techniques 
known in the art for detecting edges in images to similarly enhance the physical resolution of a 
CCD sensor. 

[0026] The illumination of the visual marker 23 can be improved using an array of light beams 
located near the visual marker 23. The illumination source 33 may be mounted on the fixed 
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structure, e.g., doorframe, or on the moving structure, e.g., elevator cab. In this way the images 
captured by the optical device 23 will have consistent quality along the path of movement. An 
infrared or ultraviolet light can also be used as the light source to illuminate the visual marker 
23. A far infrared or ultraviolet light source 33 gives better penetration capability in case of 
smoke. 

[0027] It is an advantage of the present invention that the cost of the PRS is considerably 
reduced, since the all the visual markers 23 installed along the hoistway can be of a single color 
and, if desired, a single pattern. The visual markers 23 can be illuminated with an infrared or 
ultraviolet light, which a visible light source does not interfere with, provided that an infrared or 
ultraviolet sensitive CCD sensor is used in the PRS. 

[0028] In a preferred embodiment, the PRS is calibrated by determining the precise location of 
each visual marker 23 and each location is stored in memory device 41. The contents of memory 
device 41 are accessible to the microprocessor 27. As a result, even in the event of a power 
outage or system reset, the present invention can identify its position. Specifically, the RF reader 
19 receives the coded information from a nearby RF tag 21 and passes the information to 
microprocessor 27. Based upon the coded information, microprocessor can retrieve from 
memory device 41 course position information. Subsequently, optical device 15 images the 
visual marker 23 and visual cue 31 to produce a one or two dimensional image. The image is 
forwarded to microprocessor 27 where image processing is performed, preferably sub-pixel 
processing, to accurately determine the location of visual marker 31 and to compute the precise 
location of the elevator car 29. 

[0029] It should be clear to one of ordinary skill in the art that other methods and devices for 
radio frequency identification (RFID), such as passive tags that resonate at unique frequencies or 
passively modulate the transmitted signal, are within the scope of this invention. Similarly, 
illumination sources 33, reflectors, and cameras that operate outside the visible light part of the 
electromagnetic spectrum are similarly envisioned. 

[0030] It is apparent that there has been provided in accordance with the present invention a 
system incorporating both RF ID sensing technology and CCD image processing to accurately 
assess the position of a moveable platform which fully satisfies the objects, means, and 
advantages set forth previously herein. While the present invention has been described in the 
context of specific embodiments thereof, other alternatives, modifications, and variations will 
become apparent to those skilled in the art having read the foregoing description. Accordingly, it 
is intended to embrace those alternatives, modifications, and variations as fall within the broad 
scope of the appended claims. 
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